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Introductions 



Star Wars: 1313 

Star Wars The Force Unleashed 1 & 2 

Star Wars: The Old Republic 

Monkey Island: Special Edition 1 & 2 

Forza Florizon 2 

CounterSpy 

Rogue Trooper 

Sniper Elite 
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What to expect 

• What is Henry? 

• How we worked with binaural audio 

• Audio production process for Henry 
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What is Henry? 

• VR immersive short 

• 10 minutes 

• Real time Unreal + Wwise 

• Fully binaural 

• Low level of interactivity 
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A New Medium 


• Not a film, not a game 

• New conventions: 

• Restricted movement 

• Limited interactivity 

• Limited perspective changes 

• No 4th wall 


GDC 




GAME DEVELOPERS CONFERENCE March 14-18, 2016 • Expo: March 16-18, 2016 #GDC16 





Binaural Audio 


• Builds on intrinsic acoustic understanding 

• Binaural audio has restrictions: 






Every source is mono 

Acoustically representative fall 
off curves 

Accurate source placement 
Old tricks don't work 
5.1 and 7.1 (mostly) not relevant 
Binaural recordings not so useful 





Torso 
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Binaural Audio 



Rug / Listener 
area of movement 


Binaural Off 
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Binaural Audio 


Head tracking 
Listener movement 
Room modeling 



Binaural On 
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Binaural Music 


2D/3D Balance Issue 



2D Music 
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Binaural Music 


Phantom Source Issue 
Source Balance Issue 



Placed Quad Music 
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<> 


Binaural Music 



3D Placed Stems 
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Binaural Audio 


Complete Immersion 

< r 

VR 

Acoustically accurate 
No mix control 


16-18,2016 #GDC16 


Perfect Audio Control 

▲ 

Games Film 

Complete mix control 

Non-immersive audio 


i 
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Binaural Shortcuts 

• Didn't find many 

• Loudness categories 

• Cognitive load 

• Baked reverb on sources past apertures 

• Placed Quads 

• Listener relative quads 
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Binaural Mixing 

• Mixed at Skywalker Sound 

• Guide Mix 

• Wwise + Oculus Spatializer 

• Single fall-off curve 

• Loose mix for 3D / 2D 
balance 

• Tried mixing at -24 LUFS 

• Recommend approx. -18 
LUFS for CV1 



Game and Film Processes 


• Pro Tools -> Reaper -> Wwise -> Unreal 

• Edit similar to film 

• Except for track layout 

• Tested "Guide Mix" concept 

• Reaper Render Matrix export saved time 

• 42 simultaneous mono sources max 
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Pro Tools Setup 


Bus = Mono Source 
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I/O Setup 


- Music 

- TEMP MIX FOLEY 

- TEMP MIX VO 

- TEMPMIXBALLOONS 

- TEMP MIX TOM FX 

► NonBinStl 

► NonBinSt2 

- NonBinSt3 
* NonBinSM 

► NonBinStS 

► NonBinStS 

► Narrator 


- H_Legs1 

- H_Legs2 

- H_Legs3 

- H_Legs4 

► H_Legs5 

► H_Legs6 

► H_Legs7 

► H_Torso1 

► H_Torso2 

► H_Torso3 

► H_Torso4 
<■ H_Torso5 

► H_Torso6 

► H_Torao7 

► H_Torso8 

► H_Torso9 

► H_Torso10 

- H_Torso1 1 
r H_Torso12 

► H_Torso13 

- H_Torso14 

► H_Torso15 

► H_Torso16 

► H_Torso17 

► Fairyl 

► Fairy2 

- Fairy3 

► lOtchenl 

- Kitch«n2 

► ICtchen3 

► Kitchervt 
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Output Bus 

Insert 1 Mic Pro; 


1 H/W Insert D< 


■ 

Name 

Format 


Channels 

a ► 

Music 

Stereo 

L 

R 

o ► 

NonBinSt 

Stereo 

L 

R 

o 

Narrator 

Mono 

M 


o 

HenryHead 

Mono 

M 


o 

Henry Logs 

Mono 

M 


o 

HenryTorso 

Mono 

M 


o 

Fairy 

Mono 

M 


o 

Kitchen 

Mono 

M 


o 

Cake 

Mono 

M 


o 

BallonsA 

Mono 

M 


o 

BallonsB 

Mono 

M 


o 

BaiionsC 

Mono 

M 


o 

Door 

Mono 

M 


o 

TurtloHead 

Mono 

M 


o 

TurtleLogs 

Mono 

M 


o 

TurtleTorso 

Mono 

M 


o 

LadyBug 

Mono 

M 


o 

AmbWindBack 

Mono 

M 


o 

AmbWindFront 

Mono 

M 


a 

AmbDoor 

Mono 

M 


— 
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Mono Sources 
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Reaper Setup shots 
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Reaper Setup 

Region render matrix 
auto-exports specific 
sources to match 
scene boundaries 


CO 
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Shots 

Region Render Matrix 


Region Render 


Region Manager... 


Render... 


a) 


region 
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23. SRC_Narrator 

24. SRC_HenryHead 

25. SRC_HenryTorso 

26. SRC_HenryLegs 

27. SRC_Fairy 
28. SRC_Kitchen 
29. SRC_Cake 

30. SRC_Balloons_A 

31. SRC_Balloons_B 

32. SRC_Balloons_C 

33. SRC_Door 
j 34. SRC_TurtleHead 

; 35. SRC_TurtleLegs 

36. SRC_TurtleTorso 
37. SRC_Ladybug 

38. SRC_AmbienceWin' 

39. SRC AmbienceWin 
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Wwise Setup 


F ‘- iio Events SoundBanks Game Syncs ShareSets Sessions Queries 

i 




□ ■ h010_Intro 
s ■ hllO_CakeToTable 

h 1 10_CakeToTableLong_SRC_Cake_0 1 
h 1 10_CakeT oT ableLong_SRC_HenryHead_0 1 
h 1 10_CakeT oT ableLong_SRC_HenryLegs_0 1 
h 1 10_CakeT oT ableLong_SRC_Henr yT orso_0 1 
h 1 10_CakeToTableLong_SRC J0tchen_0 1 
h 1 10_CakeToTableLong_SRC_Ladybug_0 1 
h 1 10_CakeT oT ableLong_SRC_Music_0 1 
h 1 10_CakeT oT ableShort_SRC_Cake_0 1 
h 1 10_CakeToTableShort_SRC_HenryHead_0 1 
h 1 10_CakeT oT ableShort_SRC_HenryLegs_0 1 
h 1 10_CakeT oT ableShor t_SRC_HenryT orso_0 1 
h 1 10 jCakeT oT ableShor t_SRC_Kitchen_0 1 
h 1 10_CakeT oT ableShort_SRC_Music_0 1 
hllO_INIT 

h 1 10_SRC_AmbienceBasement_0 1 
h 1 10_SRC_AmbienceDoor_0 1 
h 1 10_SRC_AmbienceFireplace_0 1 
h 1 10_SRC_AmbienceIntFL_0 1 
h 1 10_SRC_AmbienceIntFR_0 1 
h 1 10_SRC_AmbienceIntRL_0 1 
h 1 10_SRC_AmbienceIntRR_0 1 
h 1 10_SRC_AmbienceKitchen_0 1 
h 1 10_SRC_AmbienceUpstairs_0 1 
h 1 10_SRC_AmbienceWindowBack_0 1 
h 1 10_SRC_AmbienceWindowFront_0 1 
hllO_STOP 
H ■ h210_BalloonsDance 

■i h210_BalloonsDance_SRC_Balloons_A_0 1 
1 i h210_BalloonsDance_SRC_Balloons_B_0 1 
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Unreal Setup 

• All audio was 
implemented 
using blueprints 



am. 
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Unreal Setup 

• Almost all Wwise events triggered using 
"Post Event on Attach" 



• Places sound on specific bone 

• Doesn't break when object unloaded 


am. 
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GDC 


Recommendations 

• Reaper Render Matrix can save time 

• Accurately placed mono sources 

• Be aware of cognitive load 
. -18 LUFS for the CV1 

• Share the shortcuts you find! 


GDC 
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What's Next? 

• Greater interactivity 

• Interactivity breaks elements 
of the film production model 

• Real Time Mixing 

. HDR 

• Something different 
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Any Questions? 


thomasbible@gmail.com 

@tombibleaudio 

www.thomasbible.com 


